SaRF: Saliency regularized feature learning improves MRI sequence classification.

BACKGROUND AND OBJECTIVE Deep learning based medical image analysis technologies have the potential to greatly improve the workflow of neuro-radiologists dealing routinely with multi-sequence MRI. However, an essential step for current deep learning systems employing multi-sequence MRI is to ensure that their sequence type is correctly assigned. This requirement is not easily satisfied in clinical practice and is subjected to protocol and human-prone errors. Although deep learning models are promising for image-based sequence classification, robustness, and reliability issues limit their application to clinical practice. METHODS In this paper, we propose a novel method that uses saliency information to guide the learning of features for sequence classification. The method uses two self-supervised loss terms to first enhance the distinctiveness among class-specific saliency maps and, secondly, to promote similarity between class-specific saliency maps and learned deep features. RESULTS On a cohort of 2100 patient cases comprising six different MR sequences per case, our method shows an improvement in mean accuracy by 4.4% (from 0.935 to 0.976), mean AUC by 1.2% (from 0.9851 to 0.9968), and mean F1 score by 20.5% (from 0.767 to 0.924). Furthermore, based on feedback from an expert neuroradiologist, we show that the proposed approach improves the interpretability of trained models as well as their calibration with reduced expected calibration error (by 30.8%, from 0.065 to 0.045). The code will be made publicly available. CONCLUSIONS In this paper, the proposed method shows an improvement in accuracy, AUC, and F1 score, as well as improved calibration and interpretability of resulting saliency maps

On the Effect of Inter-observer Variability for a Reliable Estimation of Uncertainty of Medical Image Segmentation

Uncertainty estimation methods are expected to improve the understanding and quality of computer-assisted methods used in medical applications (e.g., neurosurgical interventions, radiotherapy planning), where automated medical image segmentation is crucial. In supervised machine learning, a common practice to generate ground truth label data is to merge observer annotations. However, as many medical image tasks show a high inter-observer variability resulting from factors such as image quality, different levels of user expertise and domain knowledge, little is known as to how inter-observer variability and commonly used fusion methods affect the estimation of uncertainty of automated image segmentation. In this paper we analyze the effect of common image label fusion techniques on uncertainty estimation, and propose to learn the uncertainty among observers. The results highlight the negative effect of fusion methods applied in deep learning, to obtain reliable estimates of segmentation uncertainty. Additionally, we show that the learned observers' uncertainty can be combined with current standard Monte Carlo dropout Bayesian neural networks to characterize uncertainty of model's parameters.Comment: Appears in Medical Image Computing and Computer Assisted Interventions (MICCAI), 201

Analysis of the robustness and dynamics of spin-locking preparations for the detection of oscillatory magnetic fields.

Extracting quantitative information of neuronal signals by non-invasive imaging is an outstanding challenge for understanding brain function and pathology. However, state-of-the-art techniques offer low sensitivity to deep electrical sources. Stimulus induced rotary saturation is a recently proposed magnetic resonance imaging sequence that detects oscillatory magnetic fields using a spin-lock preparation. Phantom experiments and simulations proved its efficiency and sensitivity, but the susceptibility of the method to field inhomogeneities is still not well understood. In this study, we simulated and analyzed the dynamic of three spin-lock preparations and their response to field inhomogeneities in the presence of a resonant oscillating field. We show that the composite spin-lock preparation is more robust against field variations within the double resonance effect. In addition, we tested the capability of the chosen composite spin-lock preparation to recover information about the spectral components of a composite signal. This study sets the bases to move one step further towards the clinical application of MR-based neuronal current imaging

More Than Spikes: On the Added Value of Non-linear Intracranial EEG Analysis for Surgery Planning in Temporal Lobe Epilepsy.

Epilepsy surgery can be a very effective therapy in medication refractory patients. During patient evaluation intracranial EEG is analyzed by clinical experts to identify the brain tissue generating epileptiform events. Quantitative EEG analysis increasingly complements this approach in research settings, but not yet in clinical routine. We investigate the correspondence between epileptiform events and a specific quantitative EEG marker. We analyzed 99 preictal epochs of multichannel intracranial EEG of 40 patients with mixed etiologies. Time and channel of occurrence of epileptiform events (spikes, slow waves, sharp waves, fast oscillations) were annotated by a human expert and non-linear excess interrelations were calculated as a quantitative EEG marker. We assessed whether the visually identified preictal events predicted channels that belonged to the seizure onset zone, that were later resected or that showed strong non-linear interrelations. We also investigated whether the seizure onset zone or the resection were predicted by channels with strong non-linear interrelations. In patients with temporal lobe epilepsy (32 of 40), epileptic spikes and the seizure onset zone predicted the resected brain tissue much better in patients with favorable seizure control after surgery than in unfavorable outcomes. Beyond that, our analysis did not reveal any significant associations with epileptiform EEG events. Specifically, none of the epileptiform event types did predict non-linear interrelations. In contrast, channels with strong non-linear excess EEG interrelations predicted the resected channels better in patients with temporal lobe epilepsy and favorable outcome. Also in the small number of patients with seizure onset in the frontal and parietal lobes, no association between epileptiform events and channels with strong non-linear excess EEG interrelations was detectable. In contrast to patients with temporal seizure onset, EEG channels with strong non-linear excess interrelations did neither predict the seizure onset zone nor the resection of these patients or allow separation between patients with favorable and unfavorable seizure control. Our study indicates that non-linear excess EEG interrelations are not strictly associated with epileptiform events, which are one key concept of current clinical EEG assessment. Rather, they may provide information relevant for surgery planning in temporal lobe epilepsy. Our study suggests to incorporate quantitative EEG analysis in the workup of clinical cases. We make the EEG epochs and expert annotations publicly available in anonymized form to foster similar analyses for other quantitative EEG methods

A multi-scale sub-voxel perfusion model to estimate diffusive capillary wall conductivity in multiple sclerosis lesions from perfusion MRI data.

We propose a new mathematical model to learn capillary leakage coefficients from dynamic susceptibility contrast MRI data. To this end, we derive an embedded mixed-dimension flow and transport model for brain tissue perfusion on a sub-voxel scale. This model is used to obtain the contrast agent concentration distribution in a single MRI voxel during a perfusion MRI sequence. We further present a magnetic resonance signal model for the considered sequence including a model for local susceptibility effects. This allows modeling MR signal-time curves that can be compared to clinical MRI data. The proposed model can be used as a forward model in the inverse modeling problem of inferring model parameters such as the diffusive capillary wall conductivity. Acute multiple sclerosis lesions are associated with a breach in the integrity of the blood brain barrier. Applying the model to perfusion MR data of a patient with acute multiple sclerosis lesions, we conclude that diffusive capillary wall conductivity is a good indicator for characterizing activity of lesions, even if other patient-specific model parameters are not well-known. This article is protected by copyright. All rights reserved

Brain Morphometry Estimation: From Hours to Seconds Using Deep Learning.

Motivation: Brain morphometry from magnetic resonance imaging (MRI) is a promising neuroimaging biomarker for the non-invasive diagnosis and monitoring of neurodegenerative and neurological disorders. Current tools for brain morphometry often come with a high computational burden, making them hard to use in clinical routine, where time is often an issue. We propose a deep learning-based approach to predict the volumes of anatomically delineated subcortical regions of interest (ROI), and mean thicknesses and curvatures of cortical parcellations directly from T1-weighted MRI. Advantages are the timely availability of results while maintaining a clinically relevant accuracy. Materials and Methods: An anonymized dataset of 574 subjects (443 healthy controls and 131 patients with epilepsy) was used for the supervised training of a convolutional neural network (CNN). A silver-standard ground truth was generated with FreeSurfer 6.0. Results: The CNN predicts a total of 165 morphometric measures directly from raw MR images. Analysis of the results using intraclass correlation coefficients showed, in general, good correlation with FreeSurfer generated ground truth data, with some of the regions nearly reaching human inter-rater performance (ICC > 0.75). Cortical thicknesses predicted by the CNN showed cross-sectional annual age-related gray matter atrophy rates both globally (thickness change of -0.004 mm/year) and regionally in agreement with the literature. A statistical test to dichotomize patients with epilepsy from healthy controls revealed similar effect sizes for structures affecting all subtypes as reported in a large-scale epilepsy study. Conclusions: We demonstrate the general feasibility of using deep learning to estimate human brain morphometry directly from T1-weighted MRI within seconds. A comparison of the results to other publications shows accuracies of comparable magnitudes for the subcortical volumes and cortical thicknesses